Additional Evidence For Construct Validity Research Articles

Utility of the Teacher Behavior Checklist beyond Psychology Majors: Replication with Brazilian Physical Education Students

The Teacher Behavior Checklist (TBC) is a worldwide valued instrument to measure teachers’ performance. Nonetheless, the studies about TBC in Brazil are still scarce, with samples mainly composed of psychology and civil engineering students. The aim of this study was to replicate the research by Keeley et al. (2010) to evaluate the psychometric properties of the Brazilian version of the TBC with a new sample. Participants were 107 undergraduates from physical education courses from a Brazilian public university. Participants used the TBC to evaluate three types of teachers: the worst they had ever had, a regular one, and the best one. The order of evaluation of teacher types did not interfere with the response patterns, but as expected, statistically significant differences were found among the three types of teachers. Additionally, the two-factor model of the TBC was confirmed through Confirmatory Factor Analysis, providing additional evidence of construct validity. However evidence to advocate in favor of a one-factor solution was also found. McDonald’s Omega results provided evidence of reliability. These findings support the use of TBC in the formative evaluation of teachersin Brazil.

A Short Measure of the Big Five Aspects: Development and Validation of the BFAS-40

We present psychometric evidence for the BFAS-40, an abbreviated measure of the Big Five Aspects Scale (DeYoung et al., 2007). In Study 1, we developed the BFAS-40 using metaheuristic algorithms and cross-validated the factor structure of the shortened measure. In Study 2, we demonstrated that the BFAS and BFAS-40 correlate with external criteria in similar ways. In Studies 3 and 4, we provide convergent validity evidence by examining correlations between the BFAS-40 and other measures of typical and clinically relevant personality. Finally, in Study 5, we provide evidence of test-retest reliability as well as additional construct validity evidence. Across these five studies, we demonstrate that the BFAS-40 is a short, reliable, and valid measure of the Big Five Aspects.

Construct Validity of the Dutch, English, French, and Spanish LPFS-BF 2.0: Measurement Invariance Across Language and Gender and Criterion Validity.

With the introduction of the Alternative Model of Personality Disorders in the DSM-5, the need for short measures of the level of personality functioning has emerged, both for screening purposes and for assessing change during treatment. The Level of Personality Functioning Scale-Brief Form 2.0 (LPFS-BF 2.0) was constructed for this and has received support for its two-factor structure and criterion validity. The authors aimed to provide additional construct validity evidence for the LPFS-BF 2.0 by examining its factor structure and measurement invariance across the Dutch, English, French, and Spanish versions and across gender, and its criterion validity. Results showed that the two-factor model had a good fit to the data in the four linguistic versions. Configural and metric invariance were supported across linguistic versions and gender, while scalar invariance was partially supported. Reporting a mental health disorder and having consulted with a mental health professional were associated with higher LPFS-BF 2.0 scores.

The ambulatory battery of creativity: Additional evidence for reliability and validity.

Psychometrically sound instruments that assess temporal dynamics of creative abilities are limited. The Ambulatory Battery of Creativity (ABC) is designed to assess creative ideation performance multiple times in everyday life and was proven to capture the intra-individual dynamic of creative abilities reliably and validly. The present ambulatory study aimed to replicate and extend the psychometric evidence of the novel ABC. Sixty-nine participants worked on the ABC during a 5-day ambulatory assessment protocol. Each day, participants completed six randomly presented items of the verbal and the figural ABC. Matching previous psychometric analyses, the results indicated good between-person (≥0.80) and good within-person (≥0.72) reliability. Furthermore, evidence for between-person and within-person validity of the ABC was obtained. Performance in the verbal and the figural ABC were interrelated and correlated with an independent measure of creative potential. The verbal ABC was further associated with openness, self-reported creative behavior, creative activities, and creative achievements, thus providing additional evidence of construct validity, especially for the verbal ABC. Finally, the verbal and the figural ABC yielded convincing within-person validity: Longer response times and higher subjective originality ratings were associated with more original ideas. This replication and extension of the ABC’s psychometric properties indicates that it enables a reliable and valid assessment of moment-to-moment fluctuations of creative ideation abilities in everyday life, which may facilitate the investigation of exciting new research questions related to dynamic aspects of creative ability.

The Unified Batten Disease Rating Scale (UBDRS): Validation and reliability in an independent CLN3 disease sample.

The neuronal ceroid lipofuscinoses (NCLs) are a group of disorders characterized by neurodegeneration and intracellular accumulation of an auto-fluorescent lipopigment. Together, NCLs represent the most common cause of cerebral neurodegenerative disease in children. CLN3 disease, the classic juvenile-onset form (JNCL) due to mutations in CLN3, is characterized by progressive vision loss, epilepsy, dementia, behavioral difficulties, and motor impairment. The Unified Batten Disease Rating Scale (UBDRS) is a disease-specific rating scale that was developed to assess disease severity in 4 domains: physical, behavior, seizures, and functional capability. Validity and reliability of the UBDRS has been established in a large North American cohort of over 130 individuals. The purpose of this study was to determine whether the UBDRS is valid and reliable when tested in an independent sample. Over the course of one week, 13 individuals with genetically confirmed CLN3 disease were evaluated with the UBDRS by 5 examiners at the University Medical Center Hamburg Eppendorf (UKE). One rater (JWM), one of the developers of the UBDRS, served as the reference standard. The other 4 raters were physicians with expertise in various forms of Batten Disease. After a formal training session, 13 individuals (age 16.5±5.6yrs) were evaluated simultaneous in parallel by the 5 raters. Inter-rater reliability of the Physical subscale was assessed with Intra-class Correlation (ICC) analysis. The relationship between age and severity was assessed and compared to previously published data from the North American cohort. The ICC among the 5 independent raters was 0.92, demonstrating excellent inter-rater reliability. The individual correlations of each UKE rater compared to the reference standard rater were all >0.95. The average UBDRS Physical Subscale score in this sample was 28±21 (mean±SD) with a range from 1 to 61. When evaluated as a function of participant age, the slope was 3.06 points/year (R2=0.66). We have shown excellent interrater reliability for the UBDRS as a clinical rating scale for CLN3 disease in a sample independent from previous work. The results of this study are comparable to those published by Kwon etal., 2011 in a North American cohort showing a slope of 2.86 points per year with a 95% CI of 2.27-3.45 (N=82). Our results demonstrate excellence inter-rater reliability after training a new group of raters and provide additional evidence for construct validity of the UBDRS. The UBDRS is a valid and reliable rating scale that can used by trained raters to assess the severity and rate of progression of CLN3 disease.

Pediatrik trakeostomi bakımı' çevrimiçi kursunun hemşirelik öğrencilerinin bilgi ve bakım verici rollerine ilişkin tutumlarına etkisi

ABSTRACT
 Aim: Childbirth self-efficacy is very important for the type and management of birth. Women with high self-efficacy prefer vaginal delivery, manage labor pain more easily, need fewer analgesic interventions, and experience fewer complications at birth. This study aimed to examine the factor structure of the Childbirth Self-Efficacy Inventory Short-Version (CBSEI-32) in Turkish pregnant women.
 Material and Method: This study was conducted in a methodological design. The sample of the study consisted of the pregnant women admitted to the obstetrics and gynecology outpatient clinic of Karaman State Hospital. The data were collected using the descriptive information form for the pregnant and the CBSEI. Numbers, percentages, arithmetic mean, factor analysis, and Cronbach’s alpha coefficient were used in the data analyses. 
 Results: As a result of the exploratory factor analysis (EFA), items 6, 12, 13 and 16 in the OE sub-dimension were excluded because their factor load values were below 0.32. And the two-factor structure consisting of 28 items was obtained as the outcome expectancy (OE) and the self-efficacy expectancy (EE). Confirmatory factor analysis (CFA) was performed to obtain additional evidence of construct validity in line with the scores of the scale. It was determined that the fit indices calculated as a result of CFA without any modification were p=0.00, 2/SD; 2.43, GFI=0.90, AGFI=0.90, CFI=0.90, and RMSEA=0.06. The total Cronbach’s alpha reliability coefficient was 0.82. 
 Conclusion: The study demonstrated that the Turkish version of the “Childbirth Self-Efficacy Inventory” is a valid and reliable tool to measure the childbirth self-efficacy of women during pregnancy.

Adult Executive Functioning Inventory (ADEXI): Factor structure, convergent validity, and reliability of a Spanish adaptation

Although there are several ratings to assess Executive Functions (EF) in adults, most of these are lengthy and comprise items which describe extreme or pathologic behaviors (e.g., ADHD symptoms), proving inadequate for the assessment of EF in general population. The Adult Executive Functioning Inventory (ADEXI) seeks to assess EF taking these limitations into account. The aims of the present study were to analyze the factor structure, the convergent and divergent validity, and the reliability of a Spanish adaptation of the ADEXI in a non-clinical population. The Spanish adaptation of the ADEXI, the Interpersonal Reactivity Index (IRI), the Cognitive Flexibility Scale (CFS), and an adaptation of the Aggression Scale (AS) were administered to 369 healthy adults between 18 and 60-years-old. To analyze the factor structure of the ADEXI, Confirmatory Factor Analysis (CFA) was used. In addition, the relationship between the inventory and the IRI, the CFS and the AS was analyzed. Finally, Cronbach’s α index was calculated. CFA showed that the two-factor model including (1) Working memory and (2) Inhibition best fit the data. Significant correlations were found between the ADEXI scores and the CFS, the IRI and the AS, providing additional evidence of construct validity. The internal consistency of the ADEXI was high (α = 0.87). Taken together, our results indicate that the Spanish adaptation of the ADEXI shows satisfactory psychometric properties and would be a valid and reliable measure to assess EF in non-clinical populations both for clinical and research purposes.

The Creative Trait Motivation Scales

Most studies investigating the effects of motivation on creativity have employed a social-psychological approach and used a dichotomous conceptualization of motivation (i.e., intrinsic and extrinsic). However, trait motivation may exist on a continuum and, although individual differences in motivation have also been found to predict creativity, no scales exist to directly assess creative trait motivation. The current report describes two studies examining the factor structure and psychometric properties of the creative trait motivation (CTM) scales. In the first study, participants (N = 580) completed three domain-specific scales (art, everyday, and science) and a well-established measure of creative self-perception. All three CTM scales demonstrated a similar factor structure, strong internal consistency for each of the factors, and evidence for construct validity. In the second study, the factor structures of the three scales were replicated employing a different sample (N = 597). The scales continued to demonstrate strong internal consistency and additional evidence for construct validity was provided, using well-established scales of both creativity and trait motivation. Together, the studies demonstrate that the domain-specific CTM scales are valuable tools for assessing creative trait motivation.

Inventář tendence k vině a hanbě (ITVAH): pilotní studie

This paper constitutes a pilot study of a novel measure for assessing proneness to guilt and proneness to shame, Inventář tendence k vině a hanbě (ITVAH, Inventory of Proneness to Guilt and Shame). ITVAH is a scenario-based method distinguishing affective and behavioural components of guilt and shame and also considering the private or public experience of guilt and shame, respectively. Two items (affective and behavioural reaction) were created for each of the 16 scenarios, resulting in total of 32 items. A four-factor measurement model was assumed – Negative behaviour evaluation (NBE), Reparation, Negative self-evaluation (NSE), Withdrawal. Next, we assumed negative correlations of NSE and Withdrawal with self-esteem and self-forgiveness and positive correlations of NBE and Reparation with self-forgiveness. The pilot study was carried out on 249 Czech-speaking adults (67 % women, aged 18–75, Md = 22). An ordinal confirmatory factor analysis with residual covariances between items connected to the same scenarios was conducted. The hypothesized four-factor model was found acceptable. However, we found limited evidence for the hypothesized relationships with self-esteem and self-forgiveness – in contrast to theoretical expectations we found a medium-strong negative relationship between self-forgiveness and affective component of guilt. For further use of the measure in the Czech and Slovak environment it is necessary to assess additional evidence of construct validity and concurrent validity with The Test of Self-Conscious Affect-3 (TOSCA-3).

Validation of the German capability for suicide questionnaire (GCSQ) in a high-risk sample of suicidal inpatients

BackgroundThe German Capability for Suicide Questionnaire (GCSQ) was developed to measure fearlessness of death and pain tolerance – two constructs central to the Interpersonal Theory of Suicide. Initial scale development, definition of the factor structure and confirmation of the two-dimensional factor structure was performed in samples suffering from relatively low levels of suicide ideation/behavior. The present study aimed to validate the German Capability for Suicide Questionnaire (GCSQ) in a high-risk sample of suicidal inpatients.MethodsFactor structure, reliability and validity were investigated in a sample of inpatients (N = 296; 53.0% female; age in years: M = 36.81, SD = 14.27) admitted to a hospital due to a recent suicide attempt or an acute suicidal crisis (in immediate need of inpatient treatment). To establish convergent validity, interview-based assessments of lifetime suicide attempts and non-suicidal self-injury as well as questionnaire-based assessments of painful and provocative events were used. Finally, stability of GCSQ-scores over a follow-up period of 12 months was assessed.ResultsResults indicated good psychometric properties, and provided additional evidence for construct validity and stability of the subscales over a one-year period, and demonstrated adequate fit of the data with respect to the original factor structure.ConclusionsResults suggest that the GCSQ is a brief, reliable, and valid measure of capability for suicide that can be used in clinic assessment and research.

The construct validity of a new screening measure of functional cognitive ability: The menu task

ABSTRACTThis study evaluated the construct validity of the Menu Task (MT): a new performance-based screening measure of functional cognition. We enrolled 114 community dwelling adults (55 years or older) in the study: all participants completed the MT and four other neuropsychological screening measures. Construct validity was evaluated using a three-step hierarchical regression model with the MT as the dependent variable. Demographic control variables were entered at step 1, followed by the Brief Interview of Mental Status (BIMS), and the Trail Making Test A (TMT A) at step 2, and finally TMT B and the Montreal Cognitive Assessment (MoCA) at step 3. It was hypothesised that measures sensitive to executive functioning (TMT B and MoCA) would significantly explain MT performance after controlling for demographic variables and adding measures of cognitive function to the model, providing additional evidence for construct validity of the MT. All three steps of the model were statistically significant (p < 0.01). Inclusion of measures sensitive to executive function in step 3 explained 30% of variability in MT score (adjusted R2 = 0.30). Our findings provide further empirical support for the construct validity of the MT, and offer implications for the use of the MT in acute and post-acute care settings.

Developing a measure to assess identity reconstruction in patients with multiple sclerosis.

To develop and test initial validation of a theory-driven quantitative measure of identity reconstruction in patients with multiple sclerosis (MS) based upon previous qualitative research. Research Method/Design: This study uses a cross-sectional survey design, in which 137 patients living with MS were recruited from an outpatient MS Center in the Southeastern U.S. Participants completed demographic items, Identity Reconstruction Assessment Scales (IRAS), Patient Determined Disease Steps, Medical Outcomes Study Measures of Patient Adherence, Chronic Disease Self-Efficacy Scale, Hospital Anxiety and Depression Scale, Leeds MS Quality of Life Questionnaire, MS-Related Stigma Scale, and Posttraumatic Growth Inventory-Short Form. The IRAS conformed to a 3-factor solution consisting of 23 items accounting for 42.6% of the variance. The 3 factors, labeled as "sustained identity" (α = .84), "reactionary identity" (α = .74), and "integrated identity" (α = .65), were not significantly correlated with each other, necessitating and allowing for independent scoring of the scales. Higher scores on "sustained identity" scale were associated with less anxiety, depression, perceived disability, and MS-related stigma, as well as with increased self-efficacy, treatment adherence, and quality of life. "Reactionary identity" scale was positively correlated with anxiety and MS-related stigma. "Integrated identity" was significantly associated with age and perceived disability. Identity reconstruction provides needed context for understanding adjustment to and living with MS. Examination of the IRAS within a larger sample and in other disease groups can provide additional construct validity evidence. (PsycINFO Database Record

Development of the Experiences of Humility Scale

In three studies, we developed the Experiences of Humility Scale (EHS). In Study 1, we used exploratory factor analysis to determine the factor structure and to reduce items in a sample of undergraduates (N = 200). The EHS had four subscales: Other-orientation, Transcendence, Awareness of Selfishness, and Awareness of Egotism. Study 2 involved an experiment with a second sample of college students (N = 106) that provided initial evidence of construct validity. Participants assigned to a Meaning Condition (i.e., writing about a most meaningful event) reported lower levels of awareness of egotism and selfishness than did participants assigned to a Neutral Condition. In Study 3, with a third sample of college students (N = 155), we replicated the factor structure of the EHS using confirmatory factor analysis and evaluated additional evidence of construct validity. As predicted, the EHS subscales predicted constructs associated with spiritual connection and meaning. Likewise, providing evidence of discriminant validity, the EHS subscales were only moderately related to traits of humility, agreeableness, and neuroticism.

Investigating Construct Validity of the Cyber-Peer Experiences Questionnaire

Abstract. Cyberaggression and cybervictimization have gained momentum as a research focus given associated mental health sequelae. To date, however, there remains little consensus on the conceptualization and measurement of these constructs. The purpose of this study was to explore construct validity evidence for the Cyber-Peer Experiences Questionnaire (C-PEQ), a novel measure that assesses experiences of cyberaggression and cybervictimization. Undergraduate participants ( n = 735) completed an online survey including the C-PEQ and other theoretically related instruments. Confirmatory factor analysis did not provide support for the hypothesized two-factor model [MLM χ2(125) = 293.58, RMSEA = .06, CFI = .87, SRMR = .06]. The C-PEQ displayed evidence for internal consistency reliability. Evidence for convergent validity with theoretically similar constructs was mixed. Specific areas of model misspecification included items 1 and 2 on both subscales (altering social media friend lists). Future research may explore additional construct validity evidence of the C-PEQ in novel samples with these items removed.

The Coleman Dog Attitude Scale (C-DAS): Development, refinement, validation, and reliability

Human–animal interactions have been studied for many years. As the human–animal interaction field continues to grow, the need for measures that adequately assess fundamental human–animal domains (e.g., relationships, interactions, attachments, bonds) also increases. Specifically, attitudes toward dogs is an important construct given that dogs are commonly owned pets and there is a preponderance of human–animal interaction research focusing on dogs. The current study involved the development, refinement, reliability, and validation of a scale measuring attitudes toward dogs (the Coleman Dog Attitude Scale; C-DAS). Items for the scale were developed through a previous unpublished study that assessed individuals’ attitudes toward dogs using the tripartite model (i.e., thoughts, feelings, and behaviors) of attitude structure. Experts winnowed down items to develop a 63-item scale for Study 1. An exploratory factor analysis was conducted on data from undergraduate students (N=502). A one-factor solution was produced and the measure was refined to a 24-item scale. The C-DAS had an alpha of 0.98. In Study 2 (N=219 undergraduates), a 2-week test-retest reliability analysis was conducted (r=0.75) and evidence of construct validity was assessed. The C-DAS had an alpha of 0.98 at Time 1 and 0.99at Time 2. In Study 3 (N=125), a community sample was utilized to conduct a confirmatory factor analysis and adduce additional evidence for construct validity. In this sample, the C-DAS had an alpha of 0.98. The C-DAS was deemed to have adequate psychometric support to be used in further research. Scores on the C-DAS predicted behavioral intentions of interacting with dogs, but did not consistently predict donating to a charity related to dogs or volunteering to help children who have a fear of dogs. The C-DAS showed significant, though weak, associations with measures of connections to animals and nature, and a strong association to measures of attitudes toward pets, providing some additional evidence of construct validity. The C-DAS has the potential to allow researchers to control for attitudes toward dogs in future studies examining human-animal interactions.

Investigating Attitudes Toward Physical Education: Validation Across Two Instruments

The Centers for Disease Control have suggested that physical education plays a role in promoting healthy lifestyles. Prior research suggests a link between attitudes toward physical education and physical activity outside school. The current study provides additional evidence of construct validity through a validation across two instruments measuring attitudes toward physical education by investigating their psychometric properties with a sample of 6th grade students (N = 377). Confirmatory factor analysis results indicate that the four-factor model fit the data well for both instruments based on fit indices, and a multitrait-multimethod analysis provides evidence of convergent and discriminant validity. Cross validation of these instruments permits longitudinal investigations on the role of attitudes toward physical education and their impact on physical activity.

The German Version of the Behavioral Activation for Depression Scale (BADS): A Psychometric and Clinical Investigation.

The Behavioral Activation for Depression Scale (BADS) was developed to measure core concepts of behavioural activation for depression. A number of studies, mostly based on analogue samples, have provided initial support for the BADS. In the present study, we examined the psychometric properties of the German version of the scale more broadly, including change sensitivity and clinical treatment data. A mixed sample of students (N = 312) and depressed outpatients in partial remission undergoing cognitive-behavioural group treatment for depressive rumination (N = 59) was examined. To analyze construct validity, a set of theoretically relevant constructs such as perseverative thinking, distraction and mindfulness was also assessed. Results indicated good psychometric properties, additional evidence for construct validity of the total scale and subscales, and adequate fit of the data to the original factor structure. Furthermore, the BADS proved to be sensitive to changes in participants undergoing treatment for depression. Copyright © 2015 John Wiley & Sons, Ltd. Behavioural activation (BA) is an effective treatment for patients suffering from unipolar depression. The Behavioral Activation for Depression Scale (BADS) can be used to measure core elements of the BA treatment rationale. It is useful to track changes in activation within treatment. The BADS is available in different languages and has shown to possess good psychometric properties.

Day-to-Day Impact of Vaginal Aging questionnaire: a multidimensional measure of the impact of vaginal symptoms on functioning and well-being in postmenopausal women.

This study aims to develop a self-report questionnaire assessing the impact of vaginal dryness, soreness, itching, irritation, and pain on functioning and well-being in postmenopausal women. Structured self-report items were developed to address the impact of vaginal symptoms on functioning and well-being based on findings from focus groups with racially/ethnically diverse, symptomatic postmenopausal women. Items were refined after cognitive interview pretesting and field-tested among symptomatic postmenopausal women enrolled in a multiethnic cohort study in California. Exploratory factor analysis (SAS PROC VARCLUS) and confirmatory factor analysis evaluated factor structure and eliminated poorly fitting items. Additional evidence of construct validity was obtained via examination of correlations with other measures of related constructs. Internal consistency and test-retest reliability were assessed using Cronbach α and correlation coefficients, respectively. For the 745 postmenopausal women who completed the draft questionnaire, the mean (SD) age was 56.2 (8.5) years, and 66% of the respondents were racial/ethnic minorities. The refined questionnaire included four multi-item scales addressing symptom impact on (1) activities of daily living, (2) emotional well-being, (3) sexual functioning, and (4) self-concept and body image. The four-factor model provided good approximate fit (comparative fit index, 0.987; standardized root-mean-square residual, 0.038). Correlations with other measures of symptom bothersomeness, sexual function, depression, and anxiety conformed to hypotheses. Cronbach α values ranged from 0.82 to 0.93. Intraclass coefficients ranged from 0.47 to 0.72. The Day-to-Day Impact of Vaginal Aging questionnaire is a new multidimensional self-report measure designed to facilitate evaluation of the impact of vaginal symptoms on postmenopausal women of diverse backgrounds.

Life Balance and Perceived Stress: Predictors and Demographic Profile

This article explored differences in life balance scores between demographic groups and whether life balance predicted perceived stress. This research used secondary analysis of 1,048 subjects from a database for the Life Balance Inventory (LBI). Analysis of variance showed that the profile of people with the highest total life balance scores was: white, 61 years or older, earned a master's degree, had incomes between $81,000 and $100,000, lived in the suburbs, had two children (but the children were not at home), were not working (if working, they were self-employed), owned a home, and lived in the United States. Other demographic groups differed in their LBI subscale scores. Regression analysis showed that life balance scores predicted lower perceived stress scores. This research provides additional construct validity evidence for the LBI and its associated Life Balance Model. [OTJR: Occupation, Participation & Health 2013;33(3):146-158.].

Relational Humility: Conceptualizing and Measuring Humility as a Personality Judgment

The study of humility has progressed slowly due to measurement problems. We describe a model of relational humility that conceptualizes humility as a personality judgment. In this set of 5 studies, we developed the 16-item Relational Humility Scale (RHS) and offered initial evidence for the theoretical model. In Study 1 (N = 300), we developed the RHS and its subscales—Global Humility, Superiority, and Accurate View of Self. In Study 2, we confirmed the factor structure of the scale in an independent sample (N = 196). In Study 3, we provided initial evidence supporting construct validity using an experimental design (N = 200). In Study 4 (N = 150), we provided additional evidence of construct validity by examining the relationships between humility and empathy, forgiveness, and other virtues. In Study 5 (N = 163), we adduced evidence of discriminant and incremental validity of the RHS compared with the Honesty-Humility subscale of the HEXACO–PI (Lee & Ashton, 2004).